United States Patent [19] 

Halliday et al. 



[54] SYSTEM FOR MANIPULATING GRAPHICAL 
COMPOSITE IMAGE COMPOSED OF 
ELEMENTS SELECTED BY USER FROM 
SEQUENTIALLY DISPLAYED MEMBERS OF 
STORED IMAGE SETS 

[75] Inventors: Mark David Halliday; Karen 

Donoghue, both of Cambridge, Mass. 

[73] Assignee: Network Sound & Light, Inc., 
Chestnut Hill, Mass. 

[21] Appl. No.: 679,297 
[22] Filed: Jul. 12, 1996 

[51] Int. CI. 6 G06T 3/00 

[52] U.S. CI 345/435 

[58] Field of Search 395/133, 135; 

345/433, 435, 348; 364/479,03 



[56] References Cited 

U.S. PATENT DOCUMENTS 
5,559,714 9/1996 Banks et al 364/479.03 



Primary Examiner — Almis R. Jankus 
Attorney, Agent, or Firm — Charles G. Call, Esq. 



Illl UmiU III ill IIB III! Ill Hill HQI U Ml Dllll III lllll llll 

US005880740A 

[11] Patent Number: 5,880,740 
[45] Date of Patent: Mar. 9, 1999 



[57] ABSTRACT 

A computer graphical image manipulation and transmission 
system which enables a user to create a composite image by 
using a positiona l input device to select individual elements 
of the composite image to be changed. The system auto- 
matically presents alternative image elements in a predeter- 
mined sequence each time a given zone of the composite 
image is specified. The image modification proceeds by 
simply selecting image areas wit h a mouse or the like , 
eliminating the need for pop-up or drop-down menus, dialog 
boxes, tool boxes, or drag-and-drop image palettes. The 
selection of any image element may also cause an ancillary 
function to be performed, including the automatic alteration 
of the image elements associated with another zone of the 
image. The image co mposite imag e thus created may be 
converted into a standard bitmap file for use in other 
programs, or may take the form of a n _data structure con- 
taining zone coo rdinates and imag e identifiers, allowing the 
image modification session to be resumed and further allow- 
ing the transfer of an complex image by sending a relatively 
small amount of data when the individual image elements 
from which the image is constructed are available to both the 
transmitting and receiving station. The image manipulation 
and viewing mechanism may be utilized in standard appli- 
cations adapted to receive and manipulate composite image 
applications in container documents, and is adapted for use 
with web browsers capable of displaying the composite 
images as imbedded i mages in web doc uments. 

20 Claims, 6 Drawing Sheets 
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SYSTEM FOR MANIPULATING GRAPHICAL 
COMPOSITE IMAGE COMPOSED OF 
ELEMENTS SELECTED BY USER FROM 
SEQUENTIALLY DISPLAYED MEMBERS OF 

STORED IMAGE SETS 5 

FIELD OF THE INVENTION 

This specification incorporates an accompanying Micro- 
fiche Appendix consisting of one microfiche and 37 frames 
which reproduces a source language listing of a computer 10 
program which implements one embodiment of the present 
invention. 

This invention relates to electronic image display systems 
and, more particularly, to apparatus for creating, displaying, 
storing and transmitting composite digital images and ani- 15 
mations. 

BACKGROUND 

Powerful computerized image editing tools are currently 
available which enable a graphics artist to produce sophis- 20 
ticated digital images for almost any purpose. These pro- 
grams frequently provide a robust set of image creation tools 
for creating precise geometric shapes, adding freehand 
image segments, modifying and manipulating digital 
photographs, composing and shaping lettering, and adding 25 
fill solid, gradient and patterned fill colors. Such programs 
do not, however, eliminate the need for artistic talent, and 
the rich assortment of illustration tools built into the more 
powerful image creation programs requires a significant 
investment of time before even a skilled artist or illustrator 30 
can become fully proficient with such a tool. 

Those without the time or skill needed to create original 
drawings can instead rely upon a rich assortment of previ- 
ously created "clip art" which is made available in purchas- 
able libraries, frequently stored on CD ROM disks whose 35 
large storage capacity is often needed to store the large data 
files needed, particularly for bit-mapped images. Clip art 
often takes the form of image segments, such as borders and 
iconic symbols which are often combined with text to form 
a composite image tailored to the particular needs. *q 

To form such an composite image, the clip-art image 
elements are normally specified by their file name using a 
dialog box and inserted into the target page, then moved into 
the desired position and sized as needed. This use of 
insertable clip-art files, although requiring less artistic skill 45 
that the creation of original images, remains a time consum- 
ing process which often falls short of producing the most 
pleasing result, particular when many image elements must 
each be chosen from many alternatives. As a consequence, 
unskilled users frequently resort to the use of a limited 50 
number of standard graphical templates which are used for 
all purposes, simply because the creation of specially tai- 
lored images to suit particular circumstances is a time 
consuming process which often yields unsatisfactory images 
that reveal that their creator is an amateur. 55 

SUMMARY 

It is a principle object of the present invention to facilitate 
the creation of composite elements consisting of several 
individual image elements, each of which is selected from a 60 
group of alternative image elements, without the need to 
identifying image elements by name, without the need to 
select image elements from a palette or toolbox or image 
elements, and without the need to drag and drop, position, 
size or otherwise manipulate selected image elements on the 65 
display screen to obtain a composite image having a pro- 
fessional look. 



2 

It is a directly related object of the invention to enable the 
creator of a composite image to immediately visualize the 
result of every image element selection in context with other 
image element selections, and to randomly replace any 
individual image element with an alternative for that ele- 
ment while viewing the entire composite image until a 
pleasing combination of elements is found, and then to 
utilize the final resulting image as desired. 

In a principle aspect, the present invention takes the form 
of an image creation mechanism which utilizes stored 
groups of images, each of which is associated with a 
predetermined zone of the overall composite image. In 
accordance with the invention, means are employed for 
generating an initial composite image consisted of a prede- 
termined set of initial individual image segments, each 
selected from one of the groups. Using a positional input 
device, such as a mouse, trackball, or the like, the user 
selects individual image elements which he or she wishes to 
change simply by "clicking" on the zone occupied by that 
element. In response, the mechanism replaces the image in 
the selected zone with the next image elements in an ordered 
group of image elements assigned to that zone. 

The invention makes it possible for the user to visually 
test many combinations quickly to find a pleasing and 
suitable combination. For example, if the image has only 
three different image zones with seven alternatives per zone 
(for example, seven different borders, seven background 
textures, and seven illustrations), there are 7x7x7=343 pos- 
sible combinations to choose from, a task which is formi- 
dable indeed when every choice involves the entry of a file 
name, the selection of a filename from a pop-up list, or the 
selection of an option from a palette or a toolbox. In 
accordance with the invention, the user simply "clicks" on 
any image zone and the next available alternative image 
element assigned to that zone replaces the previous element 
in that zone. Nothing comes between the user and the image 
being manipulated: the eye is never diverted by a distracting 
menu, file list or toolbox, and nothing but the image being 
modified need be manipulated. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIGS. 1-6 of the drawings are a sequence of illustrations 
which depict the appearance of a composite image on the 
computer screen as it is successively modified in accordance 
with the invention; 

FIG. 7 is a flowchart illustrating the operation of the 
interface mechanism for generating a composite image 
consisting of user-selected image elements; 

FIG. 8 is a data structure diagram illustrating the infor- 
mation stored to define a plurality of zones within the 
composite image; 

FIG. 9 is a data structure diagram illustrating the infor- 
mation stored to define a group of alternative images for 
each of the image zones within the composite image; 

FIG. 10 is a block schematic diagram illustrating a 
networked communications system which may be used to 
implement the invention; and 

FIG. 11 is a block diagram illustrating the cooperative 
relationship between various programmed components of an 
individual communicating computer station which embodies 
the invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

The present invention may be implemented using a con- 
ventional desktop or laptop computer which includes a 
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convention display screen for producing a visual composite the program that serves as the host for the image selection 

image and a positional input device, such as a mouse, control shown in FIGS. 1-6. 

trackball, or touch screen, which enables the user to selec- The internal functions which implement the image 

tivcly identify portions of the composite image which are to manipulation scheme illustrated in FIGS. 1-6 are depicted in 

be altered. 5 the flowchart seen in FIG. 7. 

FIG. 1 illustrates a simple rectangular composite image Regardless of the positional input device used, whether it 

consisting of a border zone 11, a rectangular greeting zone is a mouse » trackball, touchpad, digitizing tablet or a touch 

13 displaying the words "HAPPY BIRTHDAY," and a the user ' s selection is normally translated by driver 

rectangular illustration zone 15 containing drawing. The f ftware uscd „ b y th <; device into a common message 

composite image seen in FIG. 1 is displayed on a computer 10 f°™ at typicaUy caUed a mouse event In conventional 

, ... . u a u a a • a> GUI operating systems, a standardized mouse event is 

display screen, in the manner to be described, and is modi- CK&l J b the B dn ? ver in ^ t0 a hardware 

fled by a user who uses a mouse of the like to point to and ^ which fa M b ^ m ^ vement of lhe ; t 

select a particular zone. When a mouse, trackball, touchpad device ; touching a touch xteen> or the ,; ke . In tne windows 

or the like is used as the positional selection device, the user 0 erating system for example a mouse event * ^nt as a 

manipulates the input device to position a moving cursor 17, 15 m ^ ^ mti which fa sible for 

which is superimposed over the composite image, such that , be screM afea whefe , he fflouse cursor fa sitioned and 

the cursor points to and identifies a particular zone withm the da(a indicaling the natufc of the cvent; that is> 

composite image. whether it represents a mouse movement or a mouse button 

When the user presses the mouse button (or similar press ^ m p IG 7j the com posite image generation 

selection device), the zone pointed to by the moving cursor 20 routine ^ essentially a mouse event handling loop which 

is selected and the image segment which occupies the includes a routine 51 for getting the mouse event and a test 

selected zone is replaced by another image within a group of at 53 for determining if the event is a "mouse down" event 

individual image segments assigned to that zone. Thus, with representing a left mouse button press or the equivalent. If 

the cursor positioned as shown in FIG. 1 to select the lhe mouse eveDt ^ not a mouse down eventj the routine 

illustration zone 15, the system responds to the mouse button simple returns to the get mouse routine for default handling 

press by substituting a different drawing in the illustration Q f tne mouse event. 

zone as shown at 18 i n FI G. 2. ^ Tf the evem ^ a mouse down eyent) the mouse 

S^The user next uses the mouse to poinrto and~"click" on^ coordinates are extracted from the mouse event and saved as 

"^border 11 a|-iilustrated-bythe cursorposition-at-19itf ^ tne two-valued point record MPsn at 55. In addition to 

FIG. 2rcausing the individual image segment 11 which specifying particular zones within the composite image, the 

appears in the border zone as seen in FIG. 2 to be replaced mouse cursor may also be positioned over other controls 

by a new border image as seen at 21 in FIG. 3. forming part of the host application, including, for example, 

As also seen in FIG. 3, the user next positions the cursor an "OK" button or the like (not shown) used to allow the 

as seen at 23 and clicks on the greeting zone 13, causing that 35 user to indicate that the displayed image is acceptable. When 

the greeting to change to a different form as illustrated at 25 that button is depressed, as indicated by mouse coordinates 

in FIG. 4. within the boundaries of the OK button as determined by the 

In the example, the user then positions the cursor as seen test at 57, the composite image may be saved as a file at 59 

at 27 to point and select to the illustration zone which causes and the image manipulation routine is exited at 60. 

an image importing dialog box seen in FIG. 5 to be dis- 40 As discussed in more detail later, the saved file may take 

played. The dialog box 5 enables the user to specify an at least the following forms: (1) an exported bitmap of the 

stored image by filename, display the named file in a composite image in a standard bitmap file format, such as 

cropping and zooming frame seen at 31, and then close the JPEG or GIF; (2) a colle ction of t he individua l image 

dialog box to accept the cropped and zoomed image which elements ( ^tHelri dejrtfierj ^ 

is then substituted for the previously selected image in the 4sision r jn .the composite imagc^jo gether^w ith-the_zone!0 

illustration zone as seen at 36 in FIG. 7. C coordinat es,-from-which-me,sele^ 

Finally, the user may use the keyboard to add descriptive Cbe-reco hstfuctea ribr (3) the identification of the selected 

text as indicated at 25, the font used for the keyboarded text images and the sets of alternative images from which the 

being automatically selected to match or be compatible with selections were made, permitting the composite image 

the printing style chosen by the user in selecting the image 50 selected and save to be recreated but further enabling the 

segment for the greeting zone 25. Alternatively, the typeface, selection process to be restarted so that the further changes 

style, color and size of the font may be selected directly by may be made to the selected image. In cases where the 

the user in the conventional way (e.g. by using an applica- library of individual image elements will be retained and 

tion menu selection (not shown) to display and use a font available, the third form of storage provides the greatest 

definition dialog box). 55 flexibility. Where common image libraries are available to 

Using the point and click mechanism illustrated in FIGS. both a transmitting and a receiving computer, the third form 

1-4, the user may choose between a group of individual for saving the results of an image modification session also 

image segments for each of the image zones making up the forms a compact and easily transmitted file since it contains 

composite image. Because the alternative images for any only image identifiers rather than the images themselves, 

zone may be viewed, in context with the other images, 60 In general the cursor location MPsn at screen coordinates 

simply by clicking on the zone to be changed, without the (XM,YM) when a mouse down event is detected may be 

need for any other selection box, the multiple alternatives tested to determine if MPsn is within rectangular screen 

may be readily compared. When a combination of image coordinates defined by the upper left corner coordinates 

elements which suits the users objective is found, the user (XA, YA) and the lower right corner coordinates using the 

accepts the composite image as displayed on the display 65 following Pascal function: 

screen for use in other programs, typically by selecting function inside (MX, MY, XA, YA, XB, YB: integer): 

"Save" or "Save As." menu options (not shown) supplied by Boolean; begin 



03/22/2004, EAST version: 1.4.1 



5,880,740 

5 6 

inside :=(MX>=XA) and (MY>«YA) and (MX<«XB) example, to request the user to find any arbitrary image that 
and (MY<-XY); end; is available and to place an identifier for that image in the 

^ndividuin^zc^ Img_JD field of the current record before the contents of 

may overlap and ~hlvF"a^fr^rt^blck"stackmg^lati6~nshlp that field are used to display the user-selected image, 

in which the images at the back are written first and the 5 An After function may be used to alter the identity and 
images at the front are written afterwards to overlap and order of the images which are presented in any other zone of 
overwrite the bottom images. By testing the zones against the composite image. By way of example, the greeting 
the mouse coordinates from the top down, this "Z-order" is image zone seen at 13 in FIG. 16 may display "Happy 
taken into account in determining which zone is to be Birthday" in various styles, but also may display other 

considered to have been selected when the coordinates of the 10 greetings, such as "Season's Greetings/' or "Happy Valen- 
mouse cursor is positioned over two or more overlapping tines Day." Because different borders and illustrations would 
zone areas at the same. be appropriate for different greetings, a table of records 

To this end, information about each of the zones making specified by Ctable[K] ,Control_ID, each row containing an 

up the composite image is stored in an ordered information imag e iden tifier lImg_JD and a pakj^"fcncJ^Qn^pginter^ 

structure of the type shown in FIG. 8. Each zone is defined i5TBefore|~K,J1 and AfterfRj] which ide ntify^p_ecial.functions 

by a record (row) in a table indexed by a value K where the which may be performed either before or after the image 
top zone is indexed by the value K=0 and the bottom zone specified by Img_ID[K,J] is written into the zone having the 
is indexed by a value K=LastK. Each record contains a coordinates specified by Ctable[K]. Each table specifying 
Control_ID value which specifies (is a pointer to) a control the group of images and functions associated with a par- 
structure which includes the identification of each of a 20 ticular zone is terminated by a row in which Img_ID is zero, 
plurality of alternative image elements and/or functions a condition tested for at 73 to reset J to zero at 75 so that, 
associated with that zone as discussed in connection with in effect, the list of alternative images for a given zone is a 
FIG. 9. In addition, each zone record seen in FIG. 8 further circular list which continually cycles from beginning to end 
specifies the coordinates (XA, YA, XB, YB) of a rectangle and then automatically returns again to the beginning, 
which forms the zone boundary as well as a value J which 25 The ControLJD and Img_ID values seen in FIGS. 8 and 
identifies the current individual image within the group of 9 preferably take the form of pointers to objects. Objects 
images associated with that zone. specified by Control_ID pointers contain instance data 

As seen in FIG. 7, each mouse down position MPsn (other specific to each image element (Img_JD object)^which in 
than the coordinates of a "done" event detected at 57) are practice would include the zone coordinates XA,„YA,_XB3 

tested against each zone area starting from the top down. K 30 aTFdLYBIwfiicinal^ 

is initialized to zero at 63 and the coordinates of MPsn are ttidlOLach of the image element objects identified by a 
tested against the coordinates by passing the MPsn and Control_ID pointer further contain the identification of the 
Ctable[K] coordinates to the function INSIDE as indicated individual image elements; for example, an image element 
at 65. If the mouse is not in the tested zone at K, K is object may contain a pointer to a linked list of Img_JD 

incremented at 67 and, if K is not greater than LastK as 35 object pointers. Each object pointed to by an Img_ID 
determined at 69, the test at 65 is repeated. If the mouse pointer contains instance data which specifies the particular 
down event did not occur within the boundary of any zone, alternative image to be displayed; for example, each indi- 
the routine returns to 51 to await the next mouse event. vidual image object specified by an Img_JD pointer may 

Each time a mouse down event occurs which indicates contain a file name for file, or an access key value if the 

that user has selected a particular composite image zone, the 40 images are stored in a database. 

mechanism performs one of several alternative functions The individual image objects may include a polymorphic 
specified by the successor to the value J for that zone. The rendering method which displays that image on the display 
value J (from the record Ctable[K] seen in FIG. 8) is in the zone specified by the zone coordinates in the parent 
incremented at 71. The value J serves as an index to object specified by the Control_ID. The rendering method 

accompany may, for example, be created by using the MIDI 45 may, if desired, produce an animation within the specified 
player capabilities of Windows to reproduce a MIDI sheet zone, together with an audio accompaniment. An audio the 
music file whenever one image component is displayed and selection of a particular individual image in the greetings 
a different sheet music file when a different image is zone may cause a different group of images to become 
produced. As indicated at 77, if the function pointer Before associated with other zones. This may be readily accom- 

[K,J] is not a null pointer, it is known that a function 50 plished by the After function associated with the greeting 
Before[K,J] has been created to perform an operation before images which rewrites the Ctable seen in FIG. 8 to substitute 
the image currently displayed in the zone K is replaced, and different Control_IDs which specify different collections of 
a pointer to the entry point for that function is placed in the individual images. 

record for that individual image as illustrated in FIG. 9. If a Alternatively the selection of a given image in a given 

Before function exists for the current values of K and J, that 55 zone may invoke an After function which reorders the 
function is called at 79 before the image specified by images in one or more of the image tables seen if FIG. 9. In 
Img_ID[K,J] is displayed. Similarly, a test is performed at this way, the selection of a particular image in one zone may 
83 to determine if a function After[K,J] has been specified alter the order in which images are presented in another 
to be performed after the image is written. If so, that function zone. By changing the value J in a given record in the Ctable 

is performed at 85. After the image has been rewritten at 80 60 of FIG. 8, a Before or After procedure may cause the image 
an any specified Before or After functions have been currently being displayed in another zone to be altered, 
performed, control is returned to 51 to await the next user When the control values seen in FIG. 8 or 9 are changed 
zone selection. to reflect different current images than those actually 

The control system illustrated in FIGS. 7-9 accordingly displayed, the affected zones may be redrawn or the entire 

has the ability to perform a desired function either before or 65 composite image may be redrawn by redrawing the indi- 
after the replacement image is displayed. The Before func- vidual zones from the bottom up (i.e., K=LastK through K«0 
tion may be used to call the dialog box seen in FIG. 5, for as seen in FIG. 8). 
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The Before and After functions may also be programmed Microsoft or Borland C++Windows compilers, in Visual 

to perform any other desired programmable function, such Basic or Delphi compiled programs, or in many application 

as saving a file, playing an audio program or video program capable of inserting OLE, or ActiveX objects into 

animation, or transmitting a message. documents, including HTML web pages. 

The present invention may be used to advantage to 5 In a first arrangement, the utility program 208 may be 

implement image creation mechanisms in a computing envi- used to write the composite image created using the sim- 

ronment of the type illustrated in FIG. 10 of the drawings plified interface mechanism and saved as a file as indicated 

which shows a pair of computer workstations 101 and 103 at 59 in FIG. 1, This file is preferably written expressed in 
c oa^^^ia~u ^Inteniet'~105rThe worKstatioh~10Tjs^^) a standard image format, such as a JPEG, GIF, BMP, GIF, or 

connected to the"Internerl05~by an firsTInternet Service 10 WMF file. A greeting card created as described in FIGS. 

Provider (ISP) 107 and the workstation 103 is connected via 1-6, for example, may be advantageously written as a JPEG 

an ISP 109. The ISPs 107 and 109 may also provide SMTP image which can be attached as a MIME attachment to an 

/ POP email server functions to the connected client work- email message and sent via an conventional email utility, 

stations as indicated at 108 and 110 respectively. such as the popular Eudora, America Online, or Netscape 

The workstation 101 consists of a conventional personal 15 Navigator mail programs, indicated at 212, which is com- 

computer 111 provided with local read/write disk storage, municates via the Winsock TCP/IP stack routine 216 with an 

such as a hard disk drive, at 113 and a CD-ROM player 115, Internet Service Provider email server as seen at 108 and 110 

both of which store individual image elements used to form in FIG. 10. This same image file 210 may be utilized by a 

composite images. A mouse 117 is connected to provide conventional word processor 220 (e.g. Wordperfect or 

positional, zone selecting input signals to the computer 111 20 Microsoft Word) which can incorporate the image generated 

which displays the composite images on a conventional CRT by the utility program 208 into substantially any desired 

display device 121. A keyboard 123 is used to accept text output document. As indicated at 222, such word processors 

input and command from the user. The workstation 103 and many other application programs are able to insert a 

takes the form of a display kiosk which incorporates a composite image object created by the utility program into 

conventional personal computer 131, local read/write stor- 25 a container document, either as a linked object (with the 

age 133, and a CD-ROM player 135. A touch screen 140 composite image data remaining in a separate file) or as an 

provides both the output CRT display and input zone selec- imbedded object (with the composite image data becoming 

tion signals created with the kiosk user touches a displayed a part of the container document file), 

composite image zone on the screen. It should be noted, as discussed earlier, that the composite 

The works tatio ns 101 and 103 both ha ve,access4o--infor^ 30 image definition data illustrated in FIGS. 8 and 9 contain 

filiation stored~o!THTTP (HyperText Transport Protoj^l)j£ep image identifiers which may be saved and transmitted 
Isen'ers.as iUustfalejd by the server indicated>ri^whicff> instead of the actual image data when the images themselves 

dprovides web paRe-information from a' disk sto^i^e" ffriifTSy will are separately stored and accessible using the image 

^and-on"fW (File*Transferl > rotocol) file servers of the type identifiers. Thus, the image builder D LL used to select the 

illustrated at 157 illustrated as connected to a disk storage 35 compone nts of a desired cSm pT)site~miage_m^ 

units 161 which stores utility programs (composite image ima^eld entifiers to the m a ss s torage,unitj204 as a named 

authoring and viewing programs) as well as composite fileTThen, when it is desired to display or print the com- 

image sets. posite image, the image display (viewer) DLL 202 may be 

The composite image creation mechanism described in used to reconstruct the composite image previously created, 

connection with FIGS. 7-9 may be used to advantage to 40 Accordingly, by inserting a composite image OLE object 

simplify the production of images used in a variety of into a container document using the composite image utility 

application programs as illustrated by FIG. 11 of the draw- program 208 as an OLE server, the user may simply click on 

ing. The image generation mechanism illustrated in FIG. 7 the composite image in a container document created by the 

may be implemented as shareable code residing in a word processor 220 to invoke the server 208 and the 

dynamic link library (DLL) seen at 201 in FIG. 11. A 45 simplified image modification mechanism of FIG. 7 to alter 

separate image view DLL which includes instructions for the image. The modified image is then again saved as a 

displaying the composite image defined by a structure of the modified imbedded or linked OLE object in the usual way. 

type seen in FIG. 8 is included separately as indicated at 202 Definitive information on the specific structure of such an 

for use by programs which only need to display or print, but OLE server application is presented in the 

not create, such composite images. The individual images 50 OLETProgrammers Reference, Volume One (1994), pub- 

which make up a displayed or printed composite image may lished by Microsoft Press, Microsoft Corporation, 

be stored on the workstation's hard drive as indicated at 204 Redmond, Wash. 98052. 

or in a library of image elements stored on a CD-ROM disk The image builder and image viewer DLL's 201 and 202, 

as seen at 206. The image creat ion and viewing r outines as noted earlier, preferably take the form of OCX, VBX, 

stored in the DLLs 201 and 2^Sy#be-direcUy^calle^"o^ 55 jAcfiveX|br VBX visual controls which may be readily 

r^itablvrpro^ integrated into application programs using standard program 
/4inill©ilik^^ may be made a vailable by W development systems and compilers. These components 

h utility program 208carkbleof exe cution as an t?EE"(Ob"jec pt should define Before and After events to facilitate the 

L^ffigl^SMmb^ddln^^ J creation of routines for performing desired functions other 

In the Windows operating system, the utility program 208 60 than image substitution when a given individual image 

may be an independently executable EXE Windows element is being replaced. 

program, or may advantageously take the form of an As further shown in FIG. 11, the composite images 

in-process OLE server implemented as a Windows OCX produced in accordance with the invention may also be 

(more recently termed ActiveX) OLE visual component, a presented as imbedded images in documents written in 

Visual Basic VBX control, or a Borland Delphi visual 65 Hypertext Markup Language (HTML) and sent from a 

component. Such visual controls can be readily included as HTTP web server (as seen at 155 in FIG. 10) or an FTP file 

components in applications programs compiled with using server (as seen at 158 in FIG. 10). By way of example, the 
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data which makes up the composite image may be placed in 
a file having a predetermined MIME data type, the file being 
designated by a URL which is specified in the SRC param- 
eter of an HTML Imbed tag. An Imbed tag is identified by 
the browser and passed to a special MIME data handling 5 
program 230 which fetches the designated file using the 
specified URL and displays the composite image at a pre- 
determined position on the page. By way of example, the 
MIME data handling program may take the form of a 
Netscape Phigln, a dynamic code module which is called by 1Q 
the Netscape Navigator web browser to display data of a 
particular, pre-registered MIME data type when that data is 
encountered in an Imbed tag or in a file. The structure and 
function of Netscape Plug-In modules are described in detail 
in The Netscape Navigator Plug-in Software Development 
Kit (SDK), Netscape Corp., Netscape Communications Cor- 15 
poration. The Plug-in standard allows third-party developers 
to extend the capabilities of Navigator by creating new 
Netscape plug-ins. By incorporating the functionality of the 
composite image builder and viewer into a Netscape Plug- 
in, t he special formaL nsf.d.ro,stQrf-coiapQsite imarcrs using 20 
zone dennitionandima gejdentifiers (FIGS. 8 and 9) may be 
quickly transferred via the Internet to the web browser 
which requests the Plug-in display the composite data as a 
an embedded inline objects. 

Alternatively, the composite image may be displayed by 25 
the browser using a downloaded Java applet, or the com- 
posite image may take the form of an ActiveX (in-process 
OLE component) capable of translating the composite image 
data into a displayed image. Note that the individual image 
elements preferably take the form of files which may exist 30 
on the local shared CD-ROM 206, on the local mass storage 
device 204 (possibly in the browser's cache storag e area), or 

An information host source, such as America On Line, an 
HTTP web site or an FTP server, can include sets of image 35 
elements in the initially image set supplied to new subscrib- 
ers on disk, and download additional images as needed into 
local storage, thereafter transmitting only the zone coordi- 
nates and image identifiers to construct changing composite 
image combinations from the previously stored individual 40 
image elements. 

By downloading composite image definition data only, a 
particular composite image may be constructed in part from 
previously stored images and, when a given image specified 
by a component URL is not available, that needed compo- 45 
nent alone mYffib^fetched^frpm'the^ The 
Plug-In, Java or ActiveX image handler may also permit the 
user to interactively alter the image by executing a routine 
of the type shown in FIG. 7. Once again, to the extent image 
elements selected by the user are not currently available in 50 
local storage, those elements may be dynamically retrieved 
from the remote server. 

As an illustrative example of one application of the 
principles of the invention, the source program listing repro- 
duced in the microfiche appendix describes an Apple Macin- 55 
tosh program which allows users to quickly and easily create 
their own digital postcards. 

The source language was developed using, and for use 
with, Director 5.0, a multimedia authoring program avail- 
able from Macromedia, Inc., 600 Townsend Street, San 60 
Francisco, Calif. 94103-4945. The Director Player program 
from the same company permits multimedia presentations 
on CD-ROM titles to be played back on personal computers, 
Internet and interactive television. 

What is claimed is: 65 

1. A computer system for producing and storing a com- 
posite image, said system comprising: 
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means for storing zone definition data specifying the areas 
occupied by each of a plurality of different display 
zones, each of which is within the region occupied by 
said composite image, 

means for storing a plurality of groups of individual 
digital images, each of said groups being associated 
with one of said display zones, 

means for displaying in each given display zone a pre- 
determined initial image selected from the group asso- 
ciated with said given display zone to produce an initial 
composite image, 

means for accepting an input position indication from a 
user, 

matching means for comparing said input position indi- 
cation with said zone definition data to produce a 
selection signal identifying a user-specified one of said 
zones, 

means responsive to said selection signal for replacing the 
individual digital image currently displayed in said 
user-specified zone with a different individual image 
selected from the group of images associated with said 
user-specified group, 

means for accepting a completion signal from said user, 
and 

means responsive to said completion signal for storing a 
finished composite image consisting of the combina- 
tion of the individual images displayed in each of said 
zones at the time said completion signal is accepted. 

2. A computer system as set forth in claim 1 wherein said 
means for accepting an input position indication from a user 
comprises: 

means for displaying a movable cursor visible to said user 

and superimposed on said composite image, 
means for receiving input commands from said user for 

moving said visible cursor to a position within any of 

said zones selected by said user, 
means for receiving a decision signal from said user to 

produce said position indication in accordance with the 

current position of said visible cursor. 

3. A computer system as set forth in claim 1 including a 
touch screen display device for displaying said composite 
image wherein said means for accepting an input position 
indication comprises means coupled to said touch screen 
responsive to the touching of said screen by said user for 
producing said input position indication. 

4. A computer system as set forth in claim 1 wherein said 
means for storing zone definition data specifying the areas 
occupied by each of a plurality of different display zones 
includes means for defining a front to back ordered rela- 
tionship between overlapping ones of said zones. 

5. A computer system as set forth in claim 1 including 
means for establishing a predetermined order in which the 
individual images in at least a particular one of said groups 
replace one another in response to the acceptance of selec- 
tion signals. 

6. A computer system as set forth in claim 1 including 
means responsive to the display of a predetermined image in 
one of said groups for altering the order in which the 
individual images in another one of said groups replace one 
another in response to the acceptance of selection signals. 

7. A computer system as set forth in claim I including 
means responsive to the display of a first predetermined 
image in one of said zones for displaying a predetermined 
image in another of said zones. 

8. A computer display system for generating a data file 
representing a user-defined visual image comprising, in 
combination: 
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means for storing digital data representing a plurality of 
groups of individual images, 

means for defining the location of a display zone associ- 
ated with each of said groups, 

means for displaying an individual image selected from 5 
each of said groups in the particular display zone 
associated with that group, said individual images 
together forming a composite image, 

means responsive to zone selection signal from a user Q 
specifying a given one of said zones for replacing the 
image currently displayed in said given zone with 
another image from the group associated with said 
given zone, and 

means responsive to an approval signal from said user for 15 
forming a data file representative of the current content 
of said composite image, 

9. A computer display system as set forth in claim 8 
further comprising means for displaying a movable visual 
cursor which overlays said composite image, and means 2 n 
responsive to a selection command from said user for 
producing said zone selection signal when said cursor over- 
lays said given one of said zones. 

10. A computer system as set forth in claim 9 herein said 
means for defining the location of a display zone associated 2 5 
with each of said groups includes means for defining a front 

to back ordered relationship between overlapping ones of 
said zones. 

11. A computer system as set forth in claim 10 including 
means for establishing a predetermined order in which the 30 
individual images in at least a particular one of said groups 
replace one another in response to said zone selection 
signals. 

12. A computer system as set forth in claim 11 including 
means responsive to the display of a predetermined image in 35 
one of said groups for altering the order in which the 
individual images in another one of said groups replace one 
another in response to the acceptance of selection signals. 

13. A computer system as set forth in claim 8 including a 
touch screen display device for displaying said composite 40 
image, and means coupled to said touch screen responsive to 
the touching of said given one of said zones as displayed on 
said touch screen display device for producing said zone 
selection signal. 

14. A computer system as set forth in claim 13 herein said 45 
means for defining the location of a display zone associated 
with each of said groups includes means for defining a front 

to back ordered relationship between overlapping ones of 
said zones. 

15. A computer system as set forth in claim 14 including 50 
means for establishing a predetermined order in which the 
individual images in at least a particular one of said groups 
replace one another in response to said zone selection 
signals. 
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16. A computer system as set forth in claim 15 including 
means responsive to the display of a predetermined image in 
one of said groups for altering the order in which the 
individual images in another one of said groups replace one 
another in response to the acceptance of selection signals. 

17. A computer system as set forth in claim 16 including 
means responsive to the display of a first predetermined 
image in one of said zones for displaying a predetermined 
image in another of said zones. 

18. A computer system for composing and transmitting 
images from a transmitting computer to a receiving com- 
puter via a communications pathway, said transmitting com- 
puter comprising, in combination: 

means for storing digital data representing a plurality of 
groups of individual images, 

means for defining the location of a display zone associ- 
ated with each of said groups, 

means for displaying an individual image selected from 
each of said groups in the particular display zone 
associated with that group, said individual images 
together forming a composite image, 

means responsive to zone selection signal from a user 
specifying a given one of said zones for replacing the 
image currently displayed in said given zone with 
another image from the group associated with said 
given zone, 

means responsive to an approval signal from said user for 
forming a data file representative of the current content 
of said composite image, and 

means for transmitting said data file to said receiving 
computer via said communications pathway. 

19. A computer system as set forth in claim 18 wherein 
said receiving computer comprises means for storing digital 
data representing said plurality of groups of individual 
images, wherein said data file comprises image identifiers 
which designate the individual images from said groups 
which form said current content of said composite image, 
and wherein said receiving computer includes means for 
converting said data file into said composite image. 

20. A system as set forth in claim 19 further comprising: 
a server computer located remotely from said transmitting 

computer, said server computer comprising means for 
storing said digital data representing said groups of 
digital images and means responsive to a request from 
a remotely located computer for supplying said digital 
data to said remotely located computer, and wherein 
said transmitting computer includes means for trans- 
mitting a request to said server computer and means for 
receiving said digital data from said server computer. 

***** 
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